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METHOD FOR DETERMINING MOTION £ tSlTS £Tv£ 

COMPENSATION method for deterrnining motion compensation of an 

~,„™ a image a determination is made by compensating for motion 
This is a division of application Ser. No. 07/970,046 filed rf <y ^ based Qn steeled raoti on of the image. 

Nov. 2, 1992, now U.S. Pat. No. 5,369,449. Therefore, the conventional predicting method can predict 

_ _ ^ m ^^rrr^M motion compensation with a high level of precision even if 

BACKGROUND OF THE INVENTION £°tio^c £P ^ movement 

1. Field of the Invention The above-described conventional method for detcrmin- 
The present invention relates to a method for determining ing mot ion compensation, however, has problems that it is 

motion compensation of a moving image to be utilized in an not poss ible to accurately determine motion compensation 
apparatus which requires a prediction of a moving image and that) even if it is possible to correctly determination or 
such as an image transmission apparatus and an image m oUon compensation, the image density of an image to be 
apparatus. referred to becomes the image density of a reference image, 

2. Description of the Prior Art 15 which makes it impossible to make prediction at a higher 
With the progress of semiconductor technologies, meth- level of precision. 

ods for determining motion compensation to be utilized for For example, in the case of determining motion compen- 
a transmission of an image and a compression of an image sat ion by using an interlace signal as a frame and generating 
have been widely used in many fields in recent years. a block from this frame, frames are combined togethei to 
Amone such conventional methods for compensating for 20 compensate motion of an image by disregarding a dilteience 
motion of a moving image, there is one method for com- in sampling positions, due to a time difference, between two 
pensating for motion of a moving image based on one piece fields within a frame. Accordingly, when correct sampling 
of a reference image positions of the fields are considered, there is such a case that 

FIG 6 is a diagram for showing the concept of the motion compensated in the first field and motion cornpen- 
coSentiona! JSSFZ* compensating for motfon of an 2S ^tatoMOOBdll^to^c^^^o^ 
image. Referring to FIG. 6, a moving image signal is a set example of this case is shown in FIGS. 7A ° 7C_ Referring 
oTimages which are sampled with an equal time interval tO to FIGS. 7Ato7C, an input signal is a ^^T^a 
on the time axis. For example, an NTSC signal has images 7A). Interlace signals are combined together in a frame to 
:LpL?a\e^y«>sec3foreachfieldandaPALsignal determine motion <*»^«?>-™!*?^£^ 
has Ltges sampled at every V&o secondfor each field. When.30 nent of a motion detected now is 1, the first fiel d lof the M-th 
a certain object of which images are to be picked up is frame is predicted from * e J^field of the (M-l^th 
moving for example, the spatial position of an object A in frame and the second field of the M-th frame is predicted 
Tm & image is deviated from die spatial position of an from the first field of the (M-l)-th frame, as shown in FIG. 
object A in an (M-l)-th image by a portion of a move of the 7B. Moves in the correct field positions is shown in ITG. 7C. 
S during a period of tO. Now, consider a case for 35 As is clear from FIG. 7C, the motion for effecting coropen- 
Scting *e image from the (M-l)-th image. In sation in the first field of the M-thframedonotcomc.de with 

ord^to make a determination of theM-th image with a high the moves for effecting compensation in the second field of 
level of precision by compensating for motion of the object the M-th frame. As explained above when motion cornpen- 
from aL P Cprimage^ reference image during a time sation of an image is made by handling an interlace image 
difference of tO the M-th image is divided into blocks 40 as a frame, the motion for effecting compensation are 
rnS^Jat east' onepixel, anda^ove of each blockfrom different between the first field and the second field In a 
the fM-lVth image to the M-th image is detected so that a vector in which this phenomenon occurs, there is a problem 
pixelvalueof the image at a position deviated by the portion that the precision of the level of prediction is deteriorated, 
of this move is set as a determined value. This will be Next, consider a case of determining motion compensa- 
explained with reference to FIG. 6. To obtain a determined 45 tion of an image as an image of a correct position without 
value of a pixel X of the M-th image, a pixel X" at the same disregarding a time difference of sampling between images 
spatial position as the spatial position of the pixel X in the as described above. As examples of this case, there is a case 
(M-l)-th image is deviated by a detected move MV of a where motion compensation is determined for an interlace 
block unit including the pixel X*, so that a pixel X" is signal by generating a block from a field, and a case where 
obtained. This pixel X" is then used as a determined value 50 motion compensation is determined for a noninterlace sig- 
of the pixel X. In FIG. 6 the block is assumed to have a size „al. In the above cases, motion compensation is predicted by 
of 3x3 ' using an image at a position of a correct time. Therefore, 

When a signal is an interlace sisal, there are many there arises no such problem which occurs in the case of 
alternative casts considered for predicting compensation for determined motion compensation by generating a block 
motion of an image. For example, either a frame or a field 55 from a frame of the interlace signal as described above^ 
£ ^ea for SiSge and a frame is used for a reference However, in this case, motion compensation is determined 
in^S and a fieW is 8 U ;ed for an input image, etc. The basic. from one piece of reference image and the pixe 1 density _of 
Sple is as explained with reference to FIG. 6 above. As an image to be referred to becomes the pixel dens ty of the 
onTof the examples of the above method for predicting reference unage so that there is a limit to W t 
motion compensation, there is Recommendation 723, 60 determination of motion compensation at a higher level of 
^nsrnissZ o ^ component-coded digital television sig- precision. FIG. 8 shows a case of cieterrruned move corn- 
«2^^^tto£J^ atthe third hierarchical level of pensation by generating a block from a field for an input of 
CCrr™ecc™menda\ion G.702" which was standardized an interlace signal. In this case, deter.runat ion of mouou 
by the CMTT (Commission Mixte CdR/CCnT pour les compensation is^rricd out by using a field ^ image as ; a 
Transmissions TelevisueUes et Sonores 3). In this 65 reference image. Therefore, when a motion vector is C Itherc 
SSS^^T^erntoatlon of motion compensation is no sampling point at a position ' 
between frames and a determination of motion compensa- determination on the reference image and, accordingly, a 
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i:: ^ JSf-i -sots? ? u t/r a e ^=n e r;i: s 

SS by general a block based onaP^e^ ££5S*" is possible determine motion compensa- 

a frame, the case for compensating motion based on ^e neia ^ rf preclslon . 

has a pixel density in a vertical direction ^ Further according to the present invention, a vector for 

pixel density in the case of compensating a ™2%?£tZ C arS out compensation of a time position of die rete.- 

afranu,Thus.th««is.Bx«dttoa^«»tB^^M^ ^nage can be calculated from motion of the image 

^^S^^ moS^ensation at a high ievel of predion can be 

Z P Ll density of the image by using „ inter lace signal as an input signal and 

higher level of precision. 2S£|£ ^So! ^eldTto a frame linage, thus 

SUMMARY OF THE INVENTION ensuring a determination at a high precision level of motion 

With a view to eliminating the above-described pr oblems ^ c0 ^**° m ^ s^e vZe is used for a block of each 

of the prior-art technique, it is an object of the present B ™"' * m „f " M ch whole or part of spatial position oi 

Svention to provide a method for determining motion ^^^J^SX^S blocks of a plurality of 

Sensation with a very high level of precision by utilizing each bl ^ S ut ^ ^'motion detected at a certain time 

a plurality of pieces of reference images. P«cmm ar P k includin g at least one pixel, it is not 

In order to achieve the above-described object of the 25 ^Ji" ut motion detec tion a plurality of times 

present invention, the method of the preset* • ^v-tion £^* oc £ of me ptartlUy of input images, thus 

'determines motion compensation of an ™P» tma S eb ^°" ensuring a determination of motion compensation at a high 

a motion vector of a reference ^ ta ^ e » s of precision, 
txjsition of the reference image to a position of the reference i<=v y> 

image sampled at a first set time, and the method includes 30 BRIEF DESCRIPTION OF THE DRAWINGS 

Ban..—*-*- «- — 

of the input image and also consists of a plurality of pixels, the present invention; 

and calculating a motion vector of the reference image by 2A and ^ diagrams for explaining the second 

calculating a move at the first set time of a block unit which 35 embodlment 0 f the present invention; 

is a part of the reference image and also consists ot a 3 is a diagram for explaining a block for determining 

plurality of pixels, to thereby calculate morion compensation c ensation using a frame as a base; 

of the input image at a desired set time both from the motion diagrams for explaining the third 

vector of the input image and from the motion vector of the 

reference image. . 40 dlaoram f or explaining the fourth embodiment 

J»^£S.^JSS«SS - -ing the co, 

^£^&^^£S£S£ Verona! JLSSSffiS^ motion compensation; 
SESSSi S^KESt se^time, and the method 45 m 7A t0 no. 7C are diagrams for explaining prob ems 
mSudes cSS5r«otton vectors of input images by of ^ conven tional method for determining motion com- 
calculating motion at a second set time of block units, each pensat ion between frames; and 

block forming a part of each input image and also consisting g ... a for explaining the conventional 

ofTpliiraUty of pixels, and a unit for calculating a motion method fQr determimng mo tion compensation between 
vector of the reference image by calculating a .motion at the 50 flelds 

t-r^S!l*?^J!i .BSCRIFTIONOF^REFBRREO 
S motion vectors of the input images to be the same, to EMBODIMENTS 
thereby calculate motion c«npeMattoii oj ^ e in P" 1 nGlisa di agram for explaining a first embodiment of 

at a desired set time both from the motion vectors or tnc 55 nu. 1 «■ » b> 1 assumes the determination of 

mput images and the motion vector of the reference image. the presenU^en^ HOI *™ ^ signal as a „ 
before, according to the present mvention, a toie JJJ^^ block is generated from an image 
position of a reference image is compensated by^ using a inpo^ a 8 fieldandafleldijnagcisusc d as a base. In this case, 
certain motion vector depending on the need so mai : a ^ is in the M -th field and a reference miage .s 

plurality of pieces of reference images sampled at drfferen 60 theinpu ^ ( M -2)-th field. Now, 

Les according to the motion of a Wo^umt^clud^g at both j£<M^ ^ fQf move 

least one pixel, which is detected at a co ™sation of a certain block is to be detected m a 

become images of the input image at *e above time nter- ^ between ^ M . u fl ld d th e 

vals from the position of the input image. Thus, it is possible sim piify the explanation, of the detected 

to obtain a plurality of pieces of images « positioia of toe 65 £1-2) ^JW^ J^cil direction will be 
above-described time intervals from the position ^of ^theinput ™ ov «; ^ d ^ value is expresse d as a(x, y). In this 
image. By combining these images together, it is possible to consiaerea, an r 
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position of each pixel in a vertical direction is expressed ^ ^..^ ^ MV> any assum ption of 

always in the unit of a frame line. jdso be used accor ding to a certain rule lor 

Now, consider a case for obtaining a determined ^vatae of calculatin fte mv adj from the MV. Instead of using a 
(M, 1). When a vertical component of a detected MV is l, ^ ^ which is proport ional to a distance 

a determined value of motion compensation of a (M, D ^ ^ ^ values to obtaill a pixel value at a 

becomes apixel value ataposition of (M-2, 2) Next a time position, a coefficient of a low-pass filter, for 

position is corrected so that the position of the reference i ^ ^ ^ be used tQ Qbtain the pixel value at a 

image in the (M-l)-th field becomes an image at the position * position. Instead of using interpolation, for obtain- 

of the (M-2)-th field. A vector for correcting this time ^ yalue extrapolation , for example, can 

position is set as MV adj (adjustment vector). In calculating ^ ^ ^ tQ ^ necessarY pixe i value, 

the MV adj from the MV, the following relationship can be although the vector M adj for correcting positions 

easily drawn when it is assumed, for example, that motion plura uty of pieces of reference images is calculated 

from the (M-2)-th Held to the M-th field is constant: My wMch ... in a block umt 

in the above-described first embodiment of the present 
invention, the MV can also be detected independently 
MV adr-MVn 20 between the (M-l)-lh field and the (M-2)-th field. In this 

Therefore when the vertical component of the MV is 1, the by M independent detection of the MV, the tone 

Sell component of the MV adj becomes -0.5. When this coirection ^ be effec ted based on a ™r 6 accu^te ™Uon 
is applied to the positional correction for correcting the of ^ j^ge. Thus, this method has an effect that a dete* 
positions of the (M-l)-th field to the positions of the n^on of motion compensation of an image at a higher 
fM-2Vth field, a (M-l, 2) in the (M-l)-th field is corrected 25 level of precision can be ensured. 

tothe position of (M-2, 2.5) in the (M-2)-th field, as shown though an interlace signal is used as an input 

in FIG 1 After the above operation, the position of (M-2. signal and a fie i d image is assumed as each image in me 
2> which is the determined value of motion compensation of above-described first embodiment of the present invention, 
uie a (M 1) is obtained from pixel values of the (M-2)-th . a ^.jatedace image can also be used, with an effect that a 
field and' the (M-l)-th field which is the result of a time 30 determ i na tlon of motion compensation of an image can uc 
positional correction. In this case, when a necessary pixel cnsured at a higner i eve i of precision, for the same reason as 
value is to be obtained by a weighted average, which is exp iained above. tnr 
inversely proportional to a distance, from near-by pixel Next> a sec0 nd embodiment of the present invention foi 
values for example, the pixel value at the position of the determining motion compensation of an image by using an 
fM-2 'Z) that is the determined value of motion compen- 35 inter iace signal as an input signal and using a frame as an 
sation of the a (M, 1), is obtained by the following expres- input wm be explained. FIGS. 2A and 2B are diagrams for 

ex^aiiiingmesecondembodimentofthepresentinventions. 

Referring to FIGS. 2A and 2B, a reference image is m two 
fields of the previous frame, that is, the (M-l)-th field and 
a (M-% iy3+2*a(M-i,2y3 4Q the (M _2)-th field, and an input image is in two fields ot the 

Although the above explains a determination of motion ^^^^^^^^^L 

compensation taking account of only vertical components, a to FK3S 2A and 2B, « ^« u ™ „ lock is 

operation is also applied to the case for determining ^^^Tin^S ™d a reference frame and 

motion compensation for an image having both vertical and J^^^^SJS "that of the M-th field, for 

horizontal components. nf the current frame. The motion vector for 

As described above, «^]^ ^J^SSS«M*fleldl. expressed 

the present invention, a time position of a rdteacc image prearc g v ^ ^ fteld is 

is corrected by using a motion vector as requnxd so tot a as M V W each j Mon 

block unit including at least one pixel. Therefore, it is w «? b ^ n ™J 2B a determination of a pixel within the 
possible to obtain a plurality of pieces of Images at .positions ^^.^^^ b y ™ n glL ges in the (M-l)-th 
which are separated from the input image by the above time 55 M-tt. field ^^^J^ samc operation as 

intervals. A^eference image with high pixel density is ^f^^-^ 0 ^^^ y piescnl invention. For 
obtained by combining these pieces of ^^%^£^S^p^otihtMV(JMi is 1.5. 

value at a position which compensates the de tected moton value of a(M, Incomes the pixel value at 

is calculated by using the reference image of high pixel J* JSttaTof (M-2 2 .5) according to the operation which 
At TSSt£S^ Sft" jSE 60 i.^,?ai«-U«-Ji»«t. and this value is 
Tca^t^a deteSatSn of motion compensation of an obtained by die following expression: 
image at a very high precision level. 

The assumptions used in the above description of the first fl (Af-2,iy7+6MAf-i,2y7 
embodiment are flexible and the foUowing ^ernative 65 ^ as mat of the determination of 
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7 i • win ^ and FIGS 4A and 4B are diagrams for 

field is determined from the two fields of «he reference ^aine* embodiraent 0 f the present invention^ 

frame, that is, the (M-l)-th and (M-2)-th fields The^ me&od ^P™^ 3 a reference j^ge is in the (N-l)-th 
of determination in this case is the same as the method for Retemng » ^ anrf fields and a „ t 

determining a pixel within the M-«h fie d, «gt*J ^ EifE me N-th frame, that is, the M-th and (M+l)-th 
(M-2)-th field needs to be corrected to the position of the 5 unage is in Qg ^ moUon 

M-l -th field. A vector for correcting this tunc ^ositio , is ^ e N° w on a ^ ura sin ted from the frame. Assume 

set as MV adj (M+l). In calculating the ^MV adj thTamo^n vector MV is to be obtained in the block unu 
me MV(M+1), when the motion fromthe (M-2)-J fidd to tna ^ of ^ N . ft ^ fr uie 

the (M+l)-th field, for example, are constant, the f ollowing gen ^ rf ^ Uock ^ ^ case M shown 

relationship can be obtained easily: in FIG 3 In terms of the method for determining motion 

compensation based on a field, the following method can be 
ronddered The reference image is in the two fields ot the 
MV^(M +1 )=MV<M + iy2 (N-SrrameVndtheinput^ 
Therefore when the vertical component of the MV(M+1) is ^ frame . ^ detecting interval of the MV is the two-field 
?^vS component of theMV adj (M+l) becomes 0.5. i(lterval . However , the pixels included .n the above block 
As shown is FIGS 2A and 2B, when the (M-2)-th field is ^ me saiae motiLon vect0 r MV for both the pixels m the 
nositionallv corrected to the position of the (M-l)-th field, fielo and the pixels in the (M+l)-th field. 

^ 1)Tpositionally corrected to the position of th ^ other words> ^ the case of the third embodiment 

fM-1 2 5) After the above operation, the position of the moUon vectors to be used for pixels within a block generated 
(M-l 3) which is a determined value of the a(M+l, 2) is from ^ above frame take the same value regardless of 
obtained from the pixel value of the (M-l)-th field and die whcther ^ pixels belong to the M-th field or the (M+l)-* 
oixel value of the (M-2)-th field of which time position has fi u The other O p era tions become the same as those ot mc 
Sen corrected. When a necessary pixel value is to be second ^diraent. FIGS. 4A and 4B show the case ^thatthe 
obtained by a weighted average, inversely proportional to a 2J yertical component of the MV is 1. Although the ^ above 
distance from near-by pixel values, for example, a deter- - explailis the case of determining motion compensation of an 
S vafue at the position of the (M-l, 3), that is a ^ gefor only the vertical component, a simUar operauon^ 
rtermined value of motion compensation of the a(M+l, 2), ^o^ied out for the case of determining morion vector of 
is obtained by the following expression: an j^ge having both vertical and horizontal c ° m P° ne ^ f 

* 30 as described above, according to the third embodiment of 

the present invention, the same motion vector is used for 
a (M-i,4y3+2MM-2,3y3 j^j. me wo input fields positioned within a predeter- 

MAough the above explains tne detection of motion 
compensation of an image for only the vertical component ^^^^^S^, which also has an effect 

horizontal components. . above-described third embodiment also has a fiexi- 

As described above, according to the second embodiment ...^f/^ assumptions used, similar to the case of the 

of the present invention, the above-described determination My in J^f^ u ^ m number of refere „c C 
ofmon>ncorr4»ensaUoncanbeappUedtoaframeiimg^by 40 £cond ^^Kofttojotoence frame., the assumption 

using an interlace signal as an input signal and by setting a *° Sl £? n L % ™? ftom the M V, the calculation 

reference image in two fields of a certain frame. As a result pSel vlie at a necessary position, 

there is an effect that it is P"-^»"^"£ S^KM. or extrapolation is to be used can 

compensation of an image at a high level of precision oy ^ an ^ sdeBto4fe * y _ Although description has been made of 

using a frame as a base. f detennining motion compensation based on a 

The above-described second embodiment also has a flex- the case ror oe b embodiment, it is needless to 

ibility in the assumptions used, in the same manner as Oat frame as a umt m effect of ^^aUon 

of the first embodiment. For example, the number of refer- £ carried out based on a field as shown 

ence frames, the positions of the Terence frames the f n ^ e / fi ^^^^ t C ^ medeterm i D ation is carried out 

assumptions for obtaining the MV adj (M) or MV adj (M+l) 50 m the ^^ b ^ a ™ ^ F urther, when a block to be 

from either the MV(M) or the MV(M+1), the calculation based on * »° n *™ "value of the motion vector is 

method for obtaining a pixel value at a necessary potto* ™^^*JZ ^cks of a plurality of pieces of input 

and either interpolation or extrapolation, can also be selected ^^^^^^^ b Lk selected is a block of 

freely.Furuaer.althoughitisassumedinmepresentembodi- ^«" SU ^^ 0 7XVh p art or whole of the spatial 

ment that a move vector for determining motion compen- 55 each input unage <>f ™ P Qf ^ olher blocks sheeted, 

sation can be obtained within the input image ^d reference effect of prediction. Further, similar 

frame and between fields of the same phase as that of the there is no ™ embodiment, by obtaining a 

input image, it is also possible to obtain the motion vector to *° * 6 J^^^ae* of a' defection motion 

between fields of opposite phases, in the same manner of £^.5°^™*^ ^at it is possible to determine 

operation, with the similar <f?f^>^**£££ 2 Sens^uon Ma Sgher level of precision, 

correction vector is obtained independen of ™g>» fg> for chaining a fourth embodiment 

motion vector, in the same manner as that of the first WU. = i iav ^ ntion . The fourth embodiment takes the 

embodiment, there is an effect that it is possible to deter- of the P^"^ 6 ™^ rf ^ ^ st embodiment, and an 

mining motion compensation at a higher level of predion. an in P ut ^ is 

Next, as a third embodiment o the present ^ntion 65 ^erlacesignal is^ ^us P^ 8 ^ fa ^ ^ 

rerce m tp?t%"~d g rrfr^^^^^ ^m^ow**^*™-*** 
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a motion vector (MV) for determining motion compensation pixel value at a necessary position within each reference 

of a certain block is to be detected in a two-field interval, that image, and eUher interpolation or extrapolation. For cateu- 

is between the M-th field and the (M-2)-th field. To lating determined values from a plurality of pixel values 

staS fte explanation, of the detected motion, only obtained from the respective reference un^es here are 
m?tio?in a vertical direction will be considered, and a pixel 5 other alternative methods than a simple 

iiAwnwu " , . . r cuch as a weighted average method and a method roi 

value at each pixel positions expressed m the same manner Mutating by tismg Ico^fficient of a low-pass fUte, 

aS NowconsSermeca S eof obtaining a determined value of Although description has been made ^^TjTJ^l 

a(M 1) When ft is assumed that the vertical component of mining motion compensation based on a field of an interlace 

Setected MV s 3, the determined value of move com- 10 signed in the present embodiment, it is needless to mention 

^nsation of tiie a(M, 1) becomes the pixel value at the that the effect of the determination does not change rf a 

mSn of (M-2, 4). First, this pixel value is obtained from frame is used as a base or - namntertece image is used as a 

toe prxel value within the (M-2>4h field. When the pixel base as shown in the second and third embodiments respec- 

value is to be obtained *^™*£<^r™g* „ Adding to the present invention, as is clear from the 

inversely proportional to a distance, from near-by pixel 15 ^^ w f ^ £ » 

values, for example, the pixel value at the position of the above-desenbed err^odunents, a tune . positon of a rcte- 
(M-2.4) is obtained by die following expression: ence image is corrected by using a motion _ vector as reqiured 

^ ■ ; so that a plurality of pieces of reference images sampled at 

different times according to detected motion at certain time 
fl (A*-2,3y2*<i<M-2,3y2 20 intervals of a block unit including at least one pixel become 

images at times separated from the input image by the above 
Next, based on the above MV, motion of the input image intervals, so that it is possible to obtain a plurality of 

from the (M-l)-th field to the M-th field is calculated. The pieces of images at positions separated by the above time 
time difference between the M-th field and the (M-l)-th intervals from the input image. By combining the plurality 
field is V2 of the time difference between the M-th field and 25 G f pieces of images together, a reference image of high pixel 
the <M-2)-th field. Accordingly, this motion vector can be density can be obtained and a pixel value at a position wliich 
considered to be MV/2. Since the vertical component of the nas fc een compensated by the detected motion is calculated 
MV is now 3, the vertical component of MV/2 becomes 1.5. by using the reference image of high pixel density, so that 
Accordingly, when a determined value of motion compen- tne calculated pixel value is used as a determined value, 
sation of the a(M, 1) is obtained from the image in the 3Q Thus, there is an effect that it is possible to determine motion 
(M-l)-th field, this becomes the pixel value at the position compensation of an image at a very high level of precision, 
of (M- 1,2.5). This pixel value is obtained from a pixel value Further, according to the present invention, a vector for 

witliin the (M-l)-th field. When the pixel value is to be correcting a time position of the above reference image can 
obtained by a weighted average, inversely proportional to a fc e calculated based on motion detected at a certain time 
distance, from near-by pixel values, for example, the pixel 3J interval, which does not require a detection again of a 
value at the position of (M-l, 2.5) can be obtained by the motion vector for correcting the time position, so that this 
following expression: has an effect that motion compensation at a high precision 

level can be ensured. Further, since an interlace signal can be 
used as an input signal and a reference image can be in two 
3*«(A/-i,2y4+ fl <Af-i,4y4 ^ fieldg Qf a fr^^ th e above determination of motion 

Based on the two determined values obtained above, a mean compensation can be applied to a frame image thus ensuring 
of the two determined values is obtained and the result is a determination, at a high precision level, of motion corn- 
used as the determined value of the a(M, 1). pensation based on a frame. 

Although the above explains the case for deterrnining Further, since the same value can be used for a block of 

motion compensation of an image for only the vertical 45 each input image among blocks of a plurality of pieces of 

component, a similar operation is also carried out for the input images, each block having its whole or part of spatial 

case of determining motion compensation of an image position superposed with that of the other blocks, as a ^raove 

having both vertical and horizontal components. detected at a certain time interval of a block unit including 

As described above, according to the fourth embodiment at least one pixel, it is not necessary to carry out a plurality 

of the present invention, motion of an input image from a so of detections of moves of many block in a plurality of input 

plurality of pieces of reference images sampled at different s0 that there is an effect that a determination of 

times according to detected motion at certain time intervals motion compensation at a high precision level can be 

of a block unit including at least one pixel is calculated ensured, 

based on the above detected motion, and a pixel value at a We claim: 

position which has been compensated by the calculated 55 (l. A method of determining motion compensation for an 

motion portion for each reference image is calculated, so input image from motion vectors between the input image 

that it is possible to obtain a plurality of determined values ™d a plurality of reference images, said method comprising 

of motion compensation from the plurality of pieces of tne ste P s of: 

reference images. Since a determined value of the input (a) calculating a motion vector MV1 between the input 
image is calculated from the plurality of determined values, 60 image and one reference image of said plurality of 
noise can be eliminatedif noise is included in the determined reference images from a motion of at least one block 
values, thus ensuring a determination at a high precision unit at a second set time interval T 2 between die input 
level, of motion compensation. iniage and said one reference image, said at least one 
In the manner similar to die case of the first embodiment, block unit being a part of said input image and corn- 
it is also possible in the fourth embodiment to freely select 65 prising a plurality of pixels; 

the number of pieces of reference images, the positions of (b) providing a motion vector MV2 between at least two 

the reference images, the calculation method for obtaining a reference images of the plurality of reference images at 
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a first set time interval T lf which is parallel to the 
motion vector MV1 at the second set time interval i 2 
and different in magnitude from the motion vector 
MV1 at the second set time interval T 2 by a value 
determined by MVl-T/Ta; and 5 
(c) calculating the motion compensation of the input 
image from both of (i) the motion vector MV1 between 
the input image and said one reference image and (u) 
the motion vector MV2 between the at least two 
reference images of the plurality of reference images.} 
(2 A method of tetennining motion compensation for an 
input image from a motion vector between the input image 
and a plurality of reference images, said method comprising 
the steps of: t 15 

(a) detecting a motion vector MV1 between the input 
image and one reference image Rl of said plurality of 
reference images at a second set time interval T 2 ; 

(b) providing a motion vector MV3 between the reference 
image Rl and another reference image R2 of said 2Q 
plurality of reference images at a first set time interval 
Ti said motion vector MV3 being parallel to the 
motion vector MV1 and different in magnitude from 
the motion vector MV1 by a value determined by 
MVl-T/iy, 25 

(c) obtaining a motion vector MV2 between the input 
image and the another reference image R2 at a third set 
time interval T 3 from a sum of the motion vector MV1 
and the motion vector MV3, and calculating respective 
pixels corresponding to the motion vector MV1 and the 30 
motion vector MV2 from pixels of the reference image 
Rl and the reference Image R2 corresponding to the 
motion vector MV1 and the motion vector MV2 or 
from pixels positioned peripherally of the pixels of the 
reference image Rl and the reference image R2; and 



(d) calculating motion-compensated pixel values from the 

calculated pixels of the reference images J 
3 A method of obtaining a motion-compensated image 
from a motion vector between the motion-compensated 
image and a plurality of reference images, said method 
comprising the steps of: 

(a) obtaining a motion vector MV1 between the motion- 
compensated image and one reference image Rl of said 
plurality of reference images at a second set time 
interval T 2 ; 

(b) providing a motion vector MV3 between the reference 
image Rl and another reference image R2 of said 
plurality of reference images at a first set time interval 
T , which is parallel to the motion vector MV1 and 
Afferent in magnitude from the motion vector MV1 by 
a value determined by MV1-T/T 2 ; 

(c) obtaining a motion vector MV2 between the motion- 
compensated image and said another reference image 
R2 at a third set time interval T 3 from a sum of the 
motion vector MV1 and the motion vector MV3, and 
calculating respective pixels corresponding to the 
motion vector MV1 and the motion vector MV2 from 
pixels of the reference image Rl and the reference 
image R2 corresponding to the motion vector MV1 and 
the motion vector MV2 or from pixels positioned 
peripherally of the pixels of the reference image Rl and 
the reference image R2; and 

(d) calculating motion-compensated pixel values from the 
calculated pixels of the reference images to obtain the 
motion-compensated image. 




4. A method in accordance with claim 3, 
wherein said motion vector MV 1 between the motion- 
compensated imaee and said one reference imaee Rl 
of said plurality of reference images is calculated 
from a motion of at least one block unit at said second 
set time interval, said at least one block unit being a 
part of said input image and comprising a plurality of 
pixels. 

5 . A method in accordance with claim 3, 
wherein step (c) comprises obtaining said motion 
vector MV2 from a mean of said motion vector MY 1 
and said motion vector MV3, and said pixels 
positioned peripherally are valued in accordance with 
an average weighting inversely proportional to 
distance from pixels of the reference image Rl and 
the reference image R2. 

6. A method of determining motion 
compensation for an input image, said method 
comprising the steps of: 

(a) providing a first motion vector MV1 
between the input image and a reference image part rl 
of one reference image Rl of a plurality of reference 
images at a second set time interval T2 between said 
input image and said one reference image Rl : 

fb) calculating a second motion vector MV2 
between the input image and a reference image part r2 
of another reference image R2 of said plurality of 
reference images R2, said second motion vector MV2 
being parallel to said first motion vector MV1 and 
having a magnitude satisfying the relation 
MV2=MV1 • m/T2): 

(c) calculating pixel values of said reference 
image parts rl and r2 from peripheral pixels at 
positions corresponding to said first and second 
motion vectors MV1 and MV2, wherein said 
reference images Rl and R2 are previous to said input 
image in a time sequence; and 

(d) calculating, motion compensated pixel 
values of said input image from said calculated pixel 
values of said reference image parts rl and r2 to 
determine said motion compensation. 

7. A method for determining a motion- 
compensated image, said method comprising the steps 
of: 

(a) providing a first motion vector MV1 
between the motion-compensated image and a 
reference image part rl of one reference image Rl of 



a plurality of reference images at a second set time 
interval T2 between said motion compensated image 
and said one reference image Rl: 

(b) calculating a second motion vector MV2 
between the motion-compensated image and a 
reference image part r2 of another reference image R2 
of said plurality of reference images at a first set time 
interval Tl between said motion compensated image 
and said another reference image R2, said second 
motion vector MV2 being parallel to said first motion 
vector MV1 and having a magnitude satisfying the 
relation MV2=MV1 • mm): 

(c) calculating pixel values of said reference 
image parts rl and r2 from peripheral pixels at 
positions corresponding to said first and second 
motion vectors MV1 and MV2. wherein said 
reference images Rl and R2 are previous to said 
motion-compensated image in a time sequence; and 

(d) calculating motion-compensated pixel 
values from said calculated pixel values of said 
reference image parts rl and r2 to determine said 
motion-compensated image. 

8. An apparatus for deterrnining motion 
compensation for an input image, said apparatus 
comprising: 

(a) means for providing a first motion vector 
MV1 between the input image and a reference image 
part rl of one reference image Rl of a plurality of 
reference images at a second set time interval T2 
between said input image and said one reference 
image Rl; 

(b) means for calculating a second motion 
vector MV2 between the input image and a reference 
image part r2 of another reference image R2 of said 
plurality of reference images R2, said second motion 
vector MV2 being parallel to said first motion vector 
MV1 and having a magnitude satisfying the relation 
MV2=MV1 • (Tim): 

(c) means for calculating pixel values of said 
reference image parts rl and r2 from peripheral pixels 
at positions corresponding to said first and second 
motion vectors MV1 and MV2, wherein said 
reference images Rl and R2 are previous to said input 
image in a time sequence: and 

fd) means for calculating motion- 
compensated pixel values of said input image from 
said calculated pixel values of said reference image 
parts rl and r2 to determine said motion 
compensation. 
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9. An apparatus for determining a motion- 
compensated image, said apparatus comprising: 

(a) means for providing a first motion vector 
MV1 between the motion-compensated image and a 

reference image part rl of one reference image Rl of 
a plurality of reference images at a second set time 
interval T2 between said motion compensated image 
and said one reference image Rl; 

fb) means for calculating a second motion 
vector MV2 between the motion-compensated image 
and a reference image part r2 of another reference 
image R2 of said plurality of reference images at a 
first set time interval Tl between said motion 
compensated image and said another reference image 
R2, said second motion vector MV2 being parallel to 
said first motion vector MV1 and having a magnitude 
satisfying the relation MV2=MV1 - (T1/T2): 

(c) means for calculating pixel values of said 
reference image parts rl and r2 from peripheral pixels 
at positions corresponding to said first and second 
motion vectors MV1 and MV2, wherein said 
reference images Rl and R2 are previous to said 
motion-compensated image in a time sequence; and 

fd) means for calculating motion- 
compensated pixel values from said calculated pixel 
values of said reference image parts rl and r2 to 
determine said motion-compensated image. 
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ABSTRACT 



A method for predicting motion compensation for determin- 
ing of an input image based on a motion vector of the input 
image from this input image to a reference image which has 
been sampled at a first set time, and the method includes 
calculating a motion vector of the input image based on a 
move, at a second set time, of a block unit which is a part 
of the input image and consists of a plurality of pixels, and 
calculating a motion vector of the reference image based on 
a move, at the first set time, of a block unit which is a part 
of the reference image and consists of a plurality of pixels. 
Move compensation of the input image is calculated both 
from the motion vector of the input image and from the 
motion vector of the reference image, to thereby realize a 
method for determining motion compensation with high 



precision. 



3 Claims, 6 Drawing Sheets 
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